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UPDATE ESTIMATION OF DIFFUSION PARAMETER 
OBSERVED AT HIGH FREQUENCY 

YUSUKE SHIMIZU 


Abstract. We propose an update estimation method for a diffusion parameter from high- 
frequency dependent data under a nuisance drift element. We ensure the asymptotic equivalence 
of the estimator to the corresponding quasi-MLE, which has the asymptotic normality and the 
asymptotic efficiency. We give a simulation example to illustrate the theory. 


1. Introduction 


In general, under some appropriate conditions, M-estimators enjoy some nice properties, for 
example, the asymptotic efficiency of (quasi-)MLE and oracle properties of regularized estima¬ 
tors. However, it may suffer from heavy computation load since it is batch estimation in the 
sense that we have to optimize the appropriate objective function. It would be of great help to 
be able to carry out recursive estimation, where we update the estimator by doing some fine 
tuning of the previous one. In this way, it enables us to process enormous data effectively. Re¬ 
cursive estimation is established as an application of stochastic approximation theory, which is 
mainly used in control system and computer science (see e.g., Robbins and Monro [9], Nevel’son 
and Khas’minskii [8], Dvoretzky [2], Borkar [1]). The case of independent data was developed 
by, among others, Fabian [3] and [4]. We refer to Sharia [10], [11], [12] and [13] for asymptotics 
of time-series model recursive estimator. See Kutoyants [6, Section 2.6.6] and Lazrieva et al. [7] 
as well as the references therein for the case of continuous-time data from a diffusion model. 


The model we consider through this paper is the scaled Wiener process with drift: 

pt 

Xt = 


/ ^sds + ^/^wt, 
Jo 


( 1 ) 


where // is a random and time-varying nuisance process. Suppose that we observe only discrete¬ 
time sample for = jhn with hn 0, where T„ := nhn —)■ oo. We know that the 

quasi-MLE of a true value /3o with regarding /i = 0 is 


1 

= ( 2 ) 

i=i 

where = Xt^ —Xt^ ^, and has the asymptotic normality and the asymptotic efficiency. 
The aim of this paper is to propose an update estimation method for the diffusion parameter 
/3 under the nuisance drift element f fj^ds. Specifically, we wish to construct a sequence of 
estimates /3 q , /3”, , • • •, /3”, computed in a recursive manner, in such a way that for any j < n, 

the difference /3^ — ld^_i is a function described by /3J_i, hn, j, and some (not all) data, and /3” 

exhibits suitable convergence property for an arbitrary initial value /3 q. Usually this estimator 
does not require any numerically hard optimization, while its asymptotic behavior does require 
careful investigation. Note the difference from the recursive (online) estimation for sample 
Xi,X 2 ,..., where each successive estimator is obtained by using data observed one after another. 
We will bring about good asymptotic property of /3” as efficient as the quasi-MLE, i.e we ensure 
the asymptotic equivalence of to 


v/^(^r'^-/3;() Ao. 
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This paper is organized as follows. In Section 2, we propose an update formula and give a 
main theorem with the proof. We consider an example and present the simulation result to 
illustrate the theory in Section 3. 


2. Main result 


We consider the scaled Wiener process with drift (1), where /r is a random and time-varying 
nuisance process and G 0^ C M+. We denote by (P^ : /3 G 0 ^ 3 ) the family of distributions 
of X associated with /3: Pfj{B) := P o B G P(C(M_|_; M)). Let Ft '■= ctIXq, 

the underlying filtration. Suppose that we observe only discrete-time sample X„ := {Xt«)^^Q 
for t'j = jhn with hn —)• 0, where = nh„ — )■ 00 . We wish to estimate the true value (3o G Q/s 
based on X„. As is well known, the quasi-likelihood function, denote by M„, with regarding 
/I = 0 is 

Mn(/3) = ^ log ^===exp 


n 

E- 

i=i 


y/27r[3hr, 


2/3 hr. 


(3) 


Therefore, the quasi-MLE of j3 is (2), and has the asymptotic normality 


V^(/3r''^-/Io)4iV(0,2/l2) 

and the asymptotic efficiency. The aim of this paper is to propose an update estimation method 
for the diffusion parameter /3 having the form 

4” = /3”_1 + FnM-i,Xt^), J < n, 

where Fnj is an appropriate fine tuning function. The upper index n implies that we have the 
data set X„. Under the nuisance drift element f fisds, we ensure the asymptotic equivalence of 
to Therefore, the asymptotic normality and the asymptotic efficiency of hold. 

We now define some notations: denote a„ and U(/3o) by the convergence rate and the as¬ 
ymptotic variance of respectively, i.e., a„ = y/n and U(/3o) = 2/3q. We also define the 

quasi-likelihood function (3) as M„(/3) =: Then, we propose the following update 

formula: 


= P7-1 + 


vwu) 


dmnjiPj-i), j<n. 


(4) 


Note that, in finite sample, this formula is more stable than the one which is derived by direct 
using of the Newton-Raphson method. We have 


V{I3) 


2/3^ 

j 


1 


j < n, 


hence the update formula (4) is 


/?? = /3^l + 


m-i)' 


1 


= 1-7 / 3 ;-i + 


I 

(A"X)2 
jhn 




(A"A)2 

j < n. 


(5) 


Note that right-hand side of (5) is positive a.s. for any initial value /3 q G 0/?. Then, for any 
n G N and j < n we define 


1 


Mn,7 • 


Usds, 


Hi- 


Y — 


j-i 


A^X - hn-Pn,j 
Vhn/do 


Note that U 


i.i.d. 




A(0, 1 ) for j < n. Now, we set two assumptions: 


Assumption 2 . 1 . There exists 0 < eo < 1/2 such that Tn 


< jfO 
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Assumption 2.2. 


i=i 

sup sup EjSg < OO. 

n >0 t<Tn 


(6) 

(7) 


The notation An < Bn in Assumption 2.1 means that sup„(A„/i?„) < oo. The following 
Theorem 2.3 is a main result in this paper. 

Theorem 2.3. Consider the model (1). Assume that Assumptions 2.1 and 2.2 hold. Then, for 
any /3q € 0^3 the update formula (5) generates an estimator jdn, which is asymptotic equivalent 
to 


v^(/3r'^-/3") Ao. 

Therefore, it has the asymptotic normality: 


( 8 ) 


V^(/3;j-/3o) AiV(0,2/32) 


and the asymptotic efficiency. 


Proof. To prove the theorem, we use the result of Sharia [13, Lemma 1]. We change some 
notations from the original ones of Sharia [13] in terms of a triangular array of random variables. 
We drop the index n to simplify some notations. We can rewrite (5) to 




— /^i-i + 


2/3j-l j 1 {y/hnPoYj + hnpLjf 




+ 




1 _l_ A 


J I 2/3,■_! 2/3/_, 

=: /3,_i + r,(/3,_i)"^ • V'n.jA-i), 


2/ln/3? 1 




where 


A(^) 2^2 ’ (/3) + + Pj ^ 

Moreover, we define the following notations: 

l>n,j{(do-i dj—i) = Ejjg (/3,_i) 

Rn,jildo,dj-i) = r,(/3o)r“^(^,_i)6jij(/3o,d,-i); 

£n,jil3o,dj-i) = r, (/3o)r"^(/3,_i){i/)„j(/3,_i) - bn,j{/3o,dj-i)} - ifujildo), 

where dj := j3j — /3o and j < n, and introduce the conditions of Sharia [13, Lemma 1] applied to 
our model setting: 

(i) 

C ,r. X 

rn(/3o) 

w.r.t. where ?7(/3o) is a random variable with ?7(/3o) < oo P^g^-a.s.; 


11 


lim — V {(r,(/3o) - r,_i(/3o))d,_i + i?nj(/3o,d,_i)} =0 

n—)-oo \/Tl 




in probability Pg ^; 
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(iii) 


1 X ^ 

lim — dj-i) = 0 

i^cx> Jn 

j=i 


in probability . 


Now, let us show the above conditions and derive the local asymptotic linearity of /3”: 




(9) 


where 


/3: = /3o + r-H/3o) j;V’n,i(/3o) 

i=i 

is a linear statistic. Clearly, (i) holds since we have n/r„(/3o) = 2/3q. To check (ii), we calculate 
2Pj-i 

1 /3o 


dj—i y/hnldf) 



^ (i+feh.,-.]+[ ifjIT.,-.] ) 


+ 


—l) — 


j 2/3? 1 V^n/3o 


^/3o + Taf—^/3o [l/^in-^b-i] ’ 


2/3-1 


+ 


hr) 


2/3o 3 1 2/3? 1 /3? 1 


[17^/l-^b-i] 


2/3? 




1 / di- 


Pi 




Hence, we have 

(rj(/3o) — rj_i(/3o))(ij-i + Rn,jildo,dj-i) 

^ ( 2 ^ 2 ^) ^ ^ ^ 1 “ V^nPoE/So [YjlJ-j\Etj_i] + Y^do 


1 




and therefore 


1 ” 

Y, {(r,(/3o) - r,_i(/3o))d,-i + RnAPo,dj.i)} 


i=i 

h 


;£Vy^''«"NuI^.,-.] + 4e 

7=1 ^ 7=1 


^/3o [l/^jl^l-^b-i] 


( 10 ) 


J=r 

The first term of (10) converges to 0 in probability since we assume (6). Let us show 

hr: 




i=i 

in probability Pp^. Then, by making use of Markov’s inequality, Assumption 2.1 and (7), we 
obtain for any e > 0 

h ” 

P^, {\Zn\ > e) < ^ E [\h/] < hnV^ ^ 0, 

i=i 
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hence (ii). To check the condition (hi), we also calculate 
^n,j (/3o) dj — \) 


J 2/3|-i 


1 _l_ /3o 


2/32 j I 2/3,■_! 2/32_, 


Yj + /i,- 



+ 


dj—i 


/3o y 2/3? , 


y/hnl^Q 


[UAlA,..] - [pr.-.] [ - I + 4 




1 1 

Wo~Wo 



— ^2 ^ V^nPo^/So 2 • 

Assumptions 2.1 and 2.2 also ensure the condition (iii): 

1 " 
n-^oo Jn 

i=i 

in probability Consequently, we derive the local asymptotic linearity (9) from Sharia [13, 
Lemma 1]. In this case, we obtain 


= 0 


1 ” 

J. n 



□ 


therefore we can conclude the claim (8). 

Remark 2.4. See e.g., Jacod and Shiryaev [5] for more detailed discussion on the asymptotic 

^t,nt,i^;^llv linpa.r pstima.tor D 


properties of an asymptotically linear estimator. 


3. Simulation 

We performed a simulation study to validate our proposed update formula. We consider the 
model 

Xt = at + \/^wt, 

where we know the true value oq £ M. Note that this means = ao, hence Assumption 2.2 
holds. We set (aO)/3o) = (“1)3), data size N = 500 and the Monte Carlo trial number L = 100. 
We also set to satisfy Assumption 2.1. We generate {/3j^}jLo through the following 

steps: 

• Step 1: Generate a initial value (5^ by /3o + /3oC, where U ~ 17(—0.5,0.5). 

• Step 2: Update /3j^ from j = 1 to j = A' by (5) with X N{aohN, f3oh]\f), and 
obtain {/3f }jLo- 

We repeat Step 1 and 2 L times. The following Figures preset the simulation results. Figures 1 
and 2 are traces of data Xw = (X^y)^, and at I = 100, respectively {l{< L) denote each 
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steps of Monte Carlo trials), y-axis has update times j < N. The dotted line in Figure 2 denotes 
the true value /3o = 3. In Figure 3 we plot (j,/3j^) for j < N, where 





1=1 


and denotes the value of at I < L. We give a QQ-plot for Wn ■= \/N/2(3^0^ — /3o) 

in Figure 4. From the Figure 3, we expect that (5^ —> fio as N ^ oo. Actually, whenever we 

repeat this algorithm, /3)^ nearly equal to /3o and standard deviations are not so large (about 
0.19). We also expect that 


Wn 4 iV(0,1) 


as N ^ oo from the QQ-plot in Figure 4 since the plots almost lay on the 45 degree line. 



Figure 1. Trace of data Xtv. 




Figure 2. Trace of /3j^. 


Normal QQ plot for beta 



Theoretical Quantiles 


Figure 3. Trace of 


Figure 4. QQ-plot for Wn- 
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